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(54) Method and apparatus for identifying sound in a composite sound signal 



(57) Impulsive sound components in a composite 
sound signal are separated using wavelet analysis and 
sorting of wavelet coefficient sets according to statistical 
parameters of each respective coefficient set. Each en- 
tire coefficient set is either included or excluded from 



each respective separated component based on the 
statistical parameter. Once the impulsive sound compo- 
nent is isolated, it is compared with reference sound in- 
formation in order to classify the sound according to its 
potential causes. 
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Description 

[0001] The present invention relates in general to sep- 
arating an impulsive sound component from a compos- 
ite sound signal and then classifying the sound accord- 
ing to its possible source or potential cause, and more 
specifically to using wavelet transforms and sorting of 
wavelet coefficient sets to separate the impulsive com- 
ponent and comparing the impulsive component with 
previously collected reference signals. 
[0002] This application is related to U.S. application 
no. 09/1 40072, entitled "Method and Apparatus for Sep- 
aration of Impulsive and Non-Impulsive Components in 
a Signal 0 . 

[0003] Time-domain signals or waveforms may often 
include impulsive and non-impulsive components even 
though only one of these components may be of inter- 
est. For example, in either wireless or wired transmis- 
sion of electrical or electromagnetic signals, interfering 
signals and background noise contaminate the signal 
as it travels through the wireless or wired transmission 
channel. The transmitted signal contains information, 
and therefore has primarily an impulsive character. The 
interference and background noise tends to be random 
and broadband, and therefore has primarily a non-im- 
pulsive character. After transmission, it would be desir- 
able to separate the components so that the additive 
noise can be removed. 

[0004] In other applications, sound waves may be 
converted to electrical signals for transmission or for the 
purpose of analyzing the sound to determine conditions 
that created the sound. If the sound is a voice intended 
for transmission, the picked-up sound may include an 
impulsive voice component and a non-impulsive back- 
ground noise component. If the picked-up sound is cre- 
ated by operation of a machine or other environmental 
noise, the nature of the impulsive and/or non-impulsive 
sound components can be analyzed to identify specific 
noise sources or to diagnose or troubleshoot fault con- 
ditions of the machine, for example. 
[0005] Prior art attempts to reduce unwanted noise 
and interference most often treat a signal as though the 
impulsive and non-impulsive components occupy differ- 
ent frequency bands. Thus, lowpass, highpass, and 
bandpass filtering have been used to try to remove an 
undesired component. However, significant portions of 
the components often share the same frequencies. Fur- 
thermore, these frequency bands of interest are not 
known or easily determined. Therefore, frequency filter- 
ing is unable to separate the components sufficiently for 
many purposes. Fourier analysis and various Fourier- 
based frequency-domain techniques have also been 
used in attempts to reduce undesired noise compo- 
nents, but these techniques also cannot separate com- 
ponents which share the same frequencies. 
[0006] More recently, wavelet analysis has been used 
to denoise signals. Wavelet transforms are similar in 
some ways to Fourier transforms, but differ in that the 
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signal decomposition is done using a wavelet basis 
function over the plurality of time-versus-frequency 
spans, each span having a different scale. In a discrete 
wavelet transform, the decomposed input signal is rep- 
5 resented by a plurality of wavelet coefficient sets, each 
set corresponding to a respective time-versus-frequen- 
cy span. De-noising signals using wavelet analysis has 
been done in the prior art by adjusting the wavelet co- 
efficient sets by thresholding and shrinking the wavelet 
coefficients prior to recovering a time-domain signal via 
an inverse wavelet transform. However, this technique 
has not resulted in the desired signals being separated 
to the degree necessary for many applications. 
[0007] When attempting to identifying the source of a 
sound, such as when diagnosing operation of a machine 
or detecting a potential cause of an unwanted noise, the 
accuracy of identification depends upon how well the 
sound is separated from other components of the com- 
posite sound. For example, in finding and fixing squeak 
and rattle problems when servicing or developing auto- 
motive vehicles, an impulsive sound created by some 
imperfection in the vehicle must be classified according 
to its probable cause while in the presence of back- 
ground noises. Inadequate suppression of these back- 
ground noises may prevent easy classification of the im- 
pulsive sound, especially when trying to automate the 
identification. 

[0008] In one aspect of the invention, a method of 
identifying a sound in a composite sound signal includes 
converting the composite sound signal to an electrical 
signal. The electrical signal is decomposed using a 
wavelet transform to produce a plurality of sets of wave- 
let coefficients, each set of wavelet coefficients corre- 
sponding to a respective time-versus-frequency span. 
A respective statistical parameter is determined for each 
set of wavelet coefficients. An impulsive signal is re-syn- 
thesized using an inverse wavelet transform applied to 
selected ones of the sets of wavelet coefficients, the se- 
lected ones being selected in response to the respective 
statistical parameters. The impulsive signal is compared 
with a plurality of reference signals to classify the sound 
with respect to the reference signals. 
[0009] The present invention has the advantage of ac- 
curately identifying a source ol sound in a composite 
sound signal. 

[001 0] The invention will now be described, by way of 
example, with reference to the accompanying drawings, 
in which: 

Figure 1 is a functional block diagram showing a de- 
noising process of the prior art; 
Figure 2 is a functional block diagram showing an 
improved signal separation process of the present 
invention; 

Figure 3 is a block diagram showing an implemen- 
tation of the present invention in greater detail; 
Figure 4 is a flowchart showing a preferred method 
of the present invention; 
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Figure 5 is a schematic block diagram showing cus- 
tomized hardware for implementing the present in- 
vention; 

Figure 6 is a functional block diagram of a sound 
identification system according to the invention; 
Figure 7 is a flowchart showing a method of oper- 
ating the apparatus of Figure 6; 
Figure 8 is a functional block diagram of an alterna- 
tive sound identification system; 
Figure 9 is a functional blockdiagram showing a fur- 
ther embodiment using a neural network; and 
Figure 10 is a functional block diagram showing a 
signature analyzer of the present invention. 

[0011] Wavelet analysis has been used in the past to 
remove noise from data using a technique called wave- 
let shrinkage and thresholding. A wavelet transform de- 
composes a signal into wavelet coefficients, some ol 
which correspond to fine details of the input signal and 
others of which correspond to gross approximations of 
the input signal. Wavelet shrinkage and thresholding re- 
sets all coefficients to zero which have a value less than 
a threshold. This reduces the fine details which is where 
certain noise components may be represented. There- 
after, the modified coefficients are applied to an inverse 
transform to reproduce the input signal with some fine 
details missing, and therefore with a reduced noise lev- 
el. As shown in Figure 1 , a time-domain signal is applied 
to a discrete wavelet transform (DWT) 1 0. As a result of 
the decomposition, a plurality of wavelet coefficient sets 
11, individually designated as CS1 through CS8, are 
produced. Each coefficient set corresponds to a respec- 
tive time-versus-frequency span and has a plurality of 
datapoint samples. The number and locations of the 
time-versus-frequency spans are selected to maximize 
performance in any particular application. Typically, the 
range between an upper and a lower frequency is divid- 
ed geometrically (e.g., logarithmically) into the desired 
number of time-versus-frequency spans. The plurality 
of coefficient sets 1 1 are each adjusted according to the 
thresholding criteria of the wavelet shrinkage and 
thresholding technique in a plurality of adjustment 
blocks 12. The adjusted coefficient sets are provided to 
an inverse discrete wavelet transform (IDWT) 1 3 which 
reproduces a de-noised time-domain signal. 
[0012] While the technique of Figure 1 can be effec- 
tive in reducing gaussian-type noise in a noisy data sig- 
nal, the degree of signal separation obtained in certain 
applications (such as clearly separating impulsive and 
non-impulsive, non-gaussian components) is not fully 
achieved. Such signal separation is greatly improved 
using the present invention as shown generally in Figure 
2. A time-domain input signal 15 is input to a wavelet 
transform 16, A plurality of resulting wavelet coefficient 
sets are input to a kurtosis calculation 1 7. A kurtosis val- 
ue p is determined for each of the wavelet coefficient 
sets according to the ratio of the fourth-order central mo- 
ment to the squared second-order central moment of the 
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individual coefficient values within each wavelet coeffi- 
cient set. Each coefficient set has about the same 
number of datapoints as input signal 15. Each wavelet 
coefficient set corresponds to a different level or scale 
5 of the wavelet transform. Rather than modify values 
within each respective wavelet coefficient set as in the 
prior art, the present invention sorts the wavelet coeffi- 
cient sets according to the respective kurtosis values or 
with respect to some other statistical parameter. Based 
10 upon this sorting of coefficient sets, the respective im- 
pulsive and non-impulsive components of the input sig- 
nal are separated. 

[0013] Thus, the wavelet coefficient sets are sorted 
into coefficient sets 18 having kurtosis values p greater 
than a predetermined kurtosis threshold and coefficient 
sets 19 having kurtosis values p less than the predeter- 
mined kurtosis threshold. Coefficient sets 1 8 are passed 
through an inverse wavelet transform 20 to reproduce 
the impulsive component 21. Coefficient sets 19 are 
-passed through an inverse wavelet transform 22 to pro- 
duce the non-impulsive component 23. Either or both of 
these signal components are coupled to an output de- 
vice 24 which may include an audio transducer or a vid- 
eo display for reproducing audio and video signals, for 
example. 

[0014] The kurtosis value is a preferred statistical pa- 
rameter for separating the impulsive and non-impulsive 
components. However, other statistical parameters can 
be used such as mean, standard deviation, skewness, 
and variance. Furthermore, the threshold employed for 
separating the signal components may take on different 
values depending upon the signal sources. In general, 
a kurtosis threshold equal to about 5 provides good re- 
sults. 

[0015] A specific implementation of the present inven- 
tion is shown in greater detail in Figure 3. A time-domain 
signal having impulsive and non-impulsive components 
which are desired to be separated is input to a discrete 
wavelet transform (DWT) 25. A conventional DWT is 
employed. A selected basis function and the number of 
spans and locations for each time-versus-frequency 
span must be specified as is known in the art. A plurality 
of sets of wavelet coefficients CS1 through CS4 are gen- 
erated in blocks 26-29. Typically, the number of time- 
versus-frequency spans is greater than four, but four are 
shown to simplify the drawing. In many applications, a 
span number of eight has been found to provide good 
performance. 

[0016] CS1 block 26 is coupled to a kurtosis calcula- 
tion block 30. The kurtosis value from kurtosis calcula- 
tion block 30 is provided to a classifier/comparator 31 . 
A predetermined threshold is also provided to classifier/ 
comparator 31 and is compared with the kurtosis value. 
Depending upon the result of the comparison, classifier/ 
comparator 31 controls a multiplex switch 32. The input 
of multiplex switch 32 receives coefficient set CS1. The 
switch output may be switched to either an impulsive 
IDWT 36 or a non-impulsive I DWT 37. Coefficient blocks 
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27-29 and multiplex switches 33-35 are each connected 
to respective identical kurtosis calculation blocks and 
classifier/comparator blocks (not shown). Thus, coeffi- 
cient sets having a kurtosis value greater than the 
threshold are provided through their respective multi- 
plex switches to the impulsive IDWT, thereby producing 
a time-domain impulsive signal. Coefficient sets having 
a kurtosis value less than the threshold are switched to 
non-impulsive IDWT 37 to produce a time-domain non- 
impulsive signal. 

[0017] A preferred embodiment of a method accord- 
ing to the present invention is shown in Figure 4. In step 
40, a basis function, the number and location of time- 
versus-frequency spans, and a predetermined thresh- 
old are selected for a particular application of impulsive 
and non-impulsive signal separation. One example of 
an appropriate basis function may be the Debauchies 
40 basis function. A preferred number of time-versus- 
frequency spans is about eight, with the spans covering 
frequencies from zero to 22 kHz (using a common sam- 
pling rate of 44 kHz for audio signals). The spans are 
arranged geometrically and do not cover equal frequen- 
cy ranges. For example : a first span may cover from 11 
kHz to 22 kHz. A second span covers from 5.5 kHz to 
11 kHz, and so on. A preferred value for a kurtosis 
threshold may be equal to about five. 
[0018] In step 41, the input signal data is decomposed 
into the wavelet coefficient sets. A statistical parameter 
is calculated in step 42 for each respective wavelet co- 
efficient set. In a preferred embodiment, the standard 
mathematical function of calculating a kurtosis value is 
employed using the individual coefficient values within 
a wavelet coefficient sets as inputs to the calculation. 
The output of the calculation is a single kurtosis value 
for the coefficient set. In step 43, wavelet coefficient sets 
are selected or sorted based on their respective values 
of the statistical parameter. The preferred embodiment 
is comprised of selecting the ones of the sets of wavelet 
coefficients which all have a kurtosis value either greater 
than or less than the kurtosis threshold, depending upon 
whether the impulsive or non-impulsive component is 
desired for reconstruction. In step 44, that component, 
or both, are re-synthesized from the selected coefficient 
sets by applying the selected coefficient sets to an in- 
verse wavelet transform. In other words, all the wavelet 
coefficients within wavelet coefficient sets not to be in- 
cluded in a particular inverse transform are set to zero. 
[0019] After re-synthesis, signal artifacts may have 
been introduced since the inverse wavelet transform is 
processed with truncated (i.e., set to zero) data. A typ- 
ical artifact is an erroneously increased output value at 
either end of the time-domain signal. Thus, in step 45 
artifacts are removed by throwing away the endpoint 
samples in the re-synthesized time-domain signal. 
[0020] The present invention may preferably be im- 
plemented using digital signal processing (DSP) pro- 
grammable general purpose processors or specially de- 
signed application specific integrated circuits (ASICs), 



for example. Figure 5 shows a functional block diagram 
for implementation with either a general purpose DSP 
or an ASIC. An input signal is provided to an analog-to- 
digital converter 50. The input signal may be digitized at 
5 a sampling frequency f s of about 44 kHz, for example. 
The digitized signals are provided to a discrete wavelet 
transform (DWT) 51 . After decomposition, DWT 51 pro- 
vides a plurality of wavelet coefficient sets to a coeffi- 
cient-set random access memory (CSRAM) 52. The co- 
efficient sets from CSRAM 52 are provided to a bank of 
transmission gates 53 comprised of AND-gates. Each 
coefficient set is coupled to two transmission gates 
which are inversely controlled as described below. The 
outputs of each pair of transmission gates are respec- 
tively connected to either IDWT 54 or IDWT 55. IDWT 
54 provides the impulsive output signal after passing the 
inverse transform signal through a digital-to-analog con- 
verter 56. The output of IDWT 55 is connected to a dig- 
ital-to-analog converter 57 which provides the non-im- 
pulsive signal. 

[0021 ] Various control inputs are provided to a control 
logic block 60. Through these control inputs, a user can 
specify various parameters for the wavelet-based signal 
separation including the basis wavelet function, the 
number and location of time-versus-frequency spans, 
the threshold value, and other parameters such as the 
sampling rate to be used. The transform-related param- 
eters are provided to a configuration block 61 which con- 
figures DWT 51 and IDWTs 54 and 55. 
[0022] Control logic 60 also provides the threshold 
value to a threshold register 62. The threshold value is 
provided from threshold register 62 to the inverting in- 
puts of a plurality of comparators 63-66. The non-invert- 
ing inputs of comparators 63-66 receive kurtosis values 
p for respective coefficient sets from a plurality of kurto- 
sis calculators 67-70, respectively. The output of each 
comparator controls a pair of transmission gates which 
correspond to the coefficient set for which the compa- 
rator also receives the respective kurtosis value. The 
comparator output is inverted at the input to one trans- 
mission gate so that the respective coefficient set is cou- 
pled to only one of the IDWTs54or 55. Thus, the impul- 
sive and non-impulsive signal components are separat- 
ed and are available at the outputs of the DSP or ASIC 
and may be selectively used for any desired application. 
[0023] Based on the foregoing, the present invention 
automatically detects and separates impulsive signal 
components (such as static noises in communication 
signals or road-induced squeaks and rattles in automo- 
biles) from non-impulsive components (such as back- 
ground noise) for any types of signals using a predeter- 
mined threshold. The invention is adaptive to different 
types of signals and threshold levels. The invention 
achieves fast processing speed and may be implement- 
ed using general or customized integrated circuits. The 
invention may be used to identify and separate out im- 
pulsive noise signatures reflecting abnormalities of ma- 
chine operations (e.g., bearing failure, quality control is- 
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sues, etc.). The invention is also useful in communica- 
tion, medical imaging and other applications where oth- 
er impulsive noises or information need to be separated 
such as in the isolation of static noises, extraneous nois- 
es, vibrations or disturbances, and others. 
[0024] Apparatus for separating and identifying 
sounds and/or potential causes of impulsive sounds is 
shown in Figure 6. The apparatus may be used to iden- 
tify sources of squeaks, rattles, or unexpected noises in 
automotive vehicles, for example. Since these undesir- 
able noises are induced only when the vehicle is in mo- 
tion, they always coexist with background noise thereby 
making it difficult to identify their cause without first sep- 
arating the noise components. 

[0025] In Figure 6, a transducer 71 such as a micro- 
phone provides an audio signal including a composite 
sound signal through an amplifier 72 and an anti-alias- 
ing filter 73 to an analog-to-digital converter 74. A digi- 
tized composite sound signal is processed by a wavelet- 
transform signal separation block 75 to separate out the 
impulsive part of the composite signal. The impulsive 
signal may be provided to a signal analyzer 77 directly 
in digital format, or may be first converted back to analog 
format in a digital-to-analog converter 76. The analog 
impulsive signal can also be made available for audio 
playback or recording. 

[0026] Signature analyser 77 compares the impulsive 
signal with a plurality of reference signals from a data- 
base 78 to classify the impulsive sound. Based upon this 
classification, signature analyzer 77 outputs a class 
identifier (I D) corresponding to the most probable cause 
of the sound or can also output a ranked list of several 
IDs in descending order of their probability of having 
caused the impulsive sound. Alternatively, signature an- 
alyzer 77 may extract certain features of the impulsive 
signal for display on a video display 79. Corresponding 
features of the reference signals are also displayed on 
video display 79 to allow a trained person to make a vis- 
ual comparison and possible identification of the cause 
of the sound. 

[0027] A preferred method for sound identification us- 
ing the apparatus of Figure 6 is shown in Figure 7. In 
step 80, the database of reference sounds is compiled. 
To generate the database, imperfections leading to the 
unwanted sounds are deliberately created in test vehi- 
cles and the composite sounds are recorded. Impulsive 
signal separation is then employed to remove the back- 
ground noise from the reference signals. 
[0028] In step 81 , signatures of the reference signals 
are calculated and analyzed. Preferred signatures in- 
clude the statistical parameters of mean value or norm, 
standard deviation, skewness, and kurtosis value. Other 
known features of the waveforms may also be used to 
characterize the signals. 

[0029] In step 82, a composite sound is collected in a 
vehicle having an unwanted noise which is to be isolated 
and classified. The impulsive signal (representing the 
unwanted noise) is separated in step 83. A signature or 
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signatures of the separated impulsive signal are calcu- 
lated and analyzed in step 84. The signatures are the 
same signatures (e.g., statistical parameters) that were 
obtained for the reference sounds in step 81 . 
5 [0030] In step 85, the signatures are compared to de- 
termine which class best fits the impulsive signal. For 
example, a reference database may include the signa- 
tures of various vehicle suspension rattles, instrument 
panel rattles, and package tray squeaks as reference 
sounds. The best match or matches between the refer- 
ence signatures and the impulsive signature can be 
found using conventional methods, for example. Based 
on the identified class, a repair of the part or system 
causing the unwanted sound can be done. 
[0031] An alternative embodiment is shown in Figure 
8 wherein the impulsive signal is classified in the wavelet 
domain. Thus, the wavelet coefficient sets that are input 
to IDWT 86 for the impulsive component are input to a 
signature analyzer 87. The statistical parameters or oth- 
er signatures are calculated for the impulsive sets of co- 
efficients. In this embodiment, database 88 includes ref- 
erence sets of wavelet coefficients wherein each refer- 
ence set of wavelet coefficients corresponds to a re- 
spective sound classification. 

[0032] Figure 9 shows a further embodiment wherein 
the signatures of the impulsive sound are classified us- 
ing a neural network. Signature analyzer 77 provides the 
impulsive statistical parameters to a neural network 90 
which has been previously trained to recognize the de- 
sired classifications of sounds according to a training 
database 91. 

[0033] Signature analyser 77 is shown in greater de- 
tail in Figure 10. Impulsive sound samples or the impul- 
sive wavelet coefficient sets are received in a buffer 92. 
A statistics calculation block 93 determines the signa- 
tures of the impulsive sound. The statistical parameters 
may be sent to a display or may be compared in a com- 
parison block 94. The statistical parameters of the ref- 
erence sound classes are provided to a second input of 
comparison block 94 from a reference statistics buffer 
95. Based on the comparison, a ranked list 96 is derived. 
The highest ranking class ID or a list of class IDs in 
ranked order is communicated to the user. 
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Claims 

1. A method of identifying a sound in a composite 
sound signal, comprising the steps of: 

so 

converting said composite sound signal to an 
electrical signal; 

decomposing said electrical signal using a 
wavelet transform to produce a plurality of sets 
ss of wavelet coefficients, each set of wavelet co- 

efficients corresponding to a respective time- 
vers us-frequency span; 
determining a respective statistical parameter 



15 



20 



25 



30 



35 



5 



9 



EP 0 982 578 A2 



10 



for each set of wavelet coefficients; 
re-synthesising an impulsive signal using an in- 
verse wavelet transform applied to selected 
ones of said sets of wavelet coefficients, said 
selected ones being selected in response to 
said respective statistical parameters; and 
comparing said impulsive signal with a plurality 
of reference signals to classify said sound with 
respect to said reference signals. 

2. A method as claimed in claim 1 , wherein said plu- 
rality of reference signals includes sounds caused 
by squeaks and rattles in motor vehicles. 

3. A method as claimed in claim 1 , wherein said com- 
paring step is comprised of signature analysis 
wherein similarities between said impulsive signal 
and each of said reference signals are ranked. 

4. A method as claimed in claim 3, wherein said sig- 
nature analysis is comprised of determining one or 
more statistical parameters of said impulsive sound 
and comparing said statistical parameters with cor- 
responding statistical parameters of said reference 
signals. 

5. A method of identifying a sound in a composite 
sound signal, comprising the steps of: 

converting said composite sound signal to an 
electrical signal; 

decomposing said electrical signal using a 
wavelet transform to produce a plurality of sets 
of wavelet coefficients, each set of wavelet co- 
efficients corresponding to a respective time- 
versus-f requency span; 
determining a respective statistical parameter 
for each set of wavelet coefficients; 
identifying selected sets of wavelet coefficients 
as impulsive sets in response to said respective 
statistical parameters; and 
comparing said impulsive sets with a plurality 
of reference sets of wavelet coefficients to clas- 
sify said sound with respect to said reference 
sets of wavelet coefficients, wherein each ref- 
erence set of wavelet coefficients corresponds 
to a respective sound classification. 

6. A method as claimed in claim 5, wherein said plu- 
rality of reference sets of wavelet coefficients in- 
cludes decompositions of sounds caused by 
squeaks and rattles in motor vehicles. 

7. A method as claimed in claim 5, wherein said com- 
paring step is comprised of signature analysis 
wherein similarities between said impulsive sets 
and each of said reference sets of wavelet coeffi- 
cients are ranked. 



8. A method as claimed in claim 7, wherein said sig- 
nature analysis is comprised of determining one or 
more statistical parameters of said impulsive sets 
and comparing said statistical parameters with cor- 

5 responding statistical parameters of said reference 
sets of wavelet coefficients. 

9. A method as claimed in claim 5, wherein said com- 
paring step is comprised of a neural network clas- 

io sification. 

10. Apparatus for identifying a sound in a composite 
sound signal, comprising the steps of: 

'5 a transducer (71 ) for converting said composite 

sound signal to an electrical signal; 
a wavelet transformer (75) for decomposing 
said electrical signal into a plurality of wavelet 
coefficient sets; 

20 a statistical parameter calculator (77) for calcu- 

lating a statistical parameter for each wavelet 
coefficient set; 

a separator (77) for forming an impulsive group 
of wavelet coefficient sets in response to said 

2S statistical parameters; 

an inverse wavelet transformer (77) for synthe- 
sising an impulsive signal from said impulsive 
group of wavelet coefficient sets; and 
a classifier (77) for comparing said impulsive 

30 signal with a plurality of reference signals to 

classify said sound with respect to said refer- 
ence signals. 
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